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Abstract 


We consider so-called differential games of kind (qualitative 
games) involving two or more players each of whom possesses a target 
toward which he wishes to steer the response of a dynamical system 
that is under the control of all players, Sufficient conditions are 
derived, which assure termination on a particular player's target. 

In general, these conditions are constructive in that they permit 
construction of a winning (terminating) strategy for a player. The 
theory is illustrated by a pursuit-evasion problem. 
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1 . INTRODUCTION 


Diffei^ential games of kind* especially games of pursuit and evasion* 
v/ere introduced by Isaacs, Ref. 1. Much of the subsequent literature on this 
subject deals with extensions and generalizations of problems discussed by 
Isaacs; a particular favorite is the "homicidal chauffeur game", Refs. 2,3. 

These games concern situations in which two players exert control over a 
system; one player (pursuer) wishes to steer the state of the system to a 
given set, while the other player (evader) desires to keep it out of that set. 
Thus, such games involve a single set which is the pursuer's "target" and the 
evader's "anti-target". 

Differential games of kind (qualitative games) in which each of two 
players has his own target toward which he wishes to steer the system's state 
were considered by Blaqui&re et al,, Ref. 4; such multi- target games encompass 
games with a single target, of course. A general discussion of two-target games 
may be found in Ref. 4, where there are also presented conditions sufficient 
to assure one player that a particular subset of the state space is one from 
which his opponent cannot guarantee himself a win (that is, termination on 
his target). 

In this paper we consider qualitative tv/o-target differential games. 
For such games we give conditions sufficient to assure one player that a par- 
ticular subset of the state space is one from which he is guaranteed a win; 
that is, if he utilizes a strategy for which certain conditions are met and 
play begins in an appropriate subset of the state space, then he is assured 
of steering the state to his own target before his opponent can steer it to 
his. 


2. PROBLEM STATEMENT 


In order to admit a class of strategies sufficiently general to be 
of interest in many applications we allow the system under discussion to be a 
generalized dynamical system, Refs. 5, 6. 

We suppose that n real numbers , 1 = 1,2, n, fully 

describe the system at a given instant of time, t s (-w, ») . Thus, the 
system is described by a vector x = (x^, Xg. ...» ^ » loosely called 

the "state" of the system, where D is a domain or the closure of a domain 
in R*^ . The state evolves, that is, changes with time, as a trajectory of 
a generalized dynamical system 

x(t) e F(x{t), t) (1) 

where F(*) is an appropriately defined vector-valued function from 

D X r' into all nonempty subsets of R" . 

Since the system is under the control of two agents (players), 

we consider two prescribed sets, P\ i = 1, 2, of set-valued functions 

• d ♦ 

of X and t . Let u\ i = 1, 2, be given subsets of R , the players' 

control spaces.^ The elements of P^ are the i-th player's admissible 

feedback controls (strategies) p^(*) J D x ->■ all nonempty subsets of . 

12 n 

Next let there be given a function f(*)iDxUxU->-R , 
and for given p^(») s P^ ^ i = 1, 2, define F{*) by 
F(x, t) Mze D I z = f(x, u\ u^), u^ e p’(x, t)} 

= f(x, p^(x, t), p^(x, t)). 

For given (xq, tg) e D x R^ , a solution of (1) is a function 

*^0ne can allow for state and time-dependent constraint sets = U^(x, t) 
by prescribing set-valued functions Ui(*) . 


I 


r3- 

^(*) •’ C^Qj t^) ->■ D , x(tQ) = Xq , that is absolutely continuous on all 
compact subintervals of [tg, t^) and satisfies 

x(t) e f(x(t), p^(x(t), t), p^(x(t), t)) (3) 

a >61 ' 

To assure existence of solutions of (3) we make the following assumption. 
Assumption T . The sets of admissible strategies, , i = 1, 2 , are such 
that for all p^(») ^ » i = 1 » 2, and all (Xq, tQ) e D x R' , there is 

at least one solution of (31. 

Of course, the choice of satisfying Assumption 1 depends on 
function f(*) . Conditions assuring existence of a solution at (xq, Tq) 
are of the following kind (e.g., see Refs. 5,6,7): 
i) F(xq, tg) is compact and convex, and 

ii) F(*) is upper semi continuous on a compact set containing (Xq, tg) . 

Now let T.| and Tg be two prescribed closed sets contained in 
D and such that D =1= u Tg . These are the "targets" of players 1 and 2, 
respectively. 

Before we can define a "winning strategy" and a "winning set" for 

a player we need to introduce the concept of "play". 

1 2 

Definition 1 . A play is a quadruple {(xq, tg) , p (•)» P (*) > x(*))' such 
that 

(Xq. t„) e [D \(r, U Tj)] X r' . 

2 . p^’(‘) e P^ , i = 1 , 2 , 

^Given two sets, A and B,A\B-{asA|a4B}. 
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3. x(-) CtQ, t^] D , or x{‘) [tQ, t^) ’>• D if x(t^) is not 
defined, with x(tg) - Xq , is a solution of (3) generated by 
P^*} , i = 1, 2, 

4. x(t} 4 ’J'l ^ ^2 ^ ^ ^*'0’ ^f^ * 

5. either i) x(t^) e u Tg for t^ < « , or 

ii) t^ = “ , or 

iii) t^ is a finite escape time for x(*) ; 

that is, x(t) ->■ x e 3D or II x(t) !!->■“ as 

t -> tf . 

Now we can define the concepts of winning strategy at a point 
and then of a winning set. 

'^1 1 

Definition 2 . A strategy p {•) e p' is winning for player 1 at 

(xq, tg) e [D \ (f^ u Tg)] ^ iff the set of plays 

{{Xg, tg) , pV*) , p^(*) , x{‘)) for all p^(0 s is nonempty and 

contains no^ members satisfying 5i) with x{t^) e , or 5ii) or 5iii) of 
Definition 1. A completely analogous definition, with 1 and 2 inter- 

Ap 2 

changed, holds for a winning strategy p (•) ^ p at (Xg, tg) . 

Simply stated, a winning strategy for a player at (Xg, tg) 
guarantees termination on his, and only his, target no matter what the 
strategy of the other player. 

Definition 3 . A set W c D \ (l^ u Tg) is 1-winning { or 2-winning) iff 
player 1 (or 2) has a strategy p (•) (or p (•)) that is winning for 
him at all (xg, tg) s w x . 


An essential part of the solution of a game is the mapping of 
D into its 1-winning and 2-winning subsets, along with the characterization 
of the associated winning strategies, p (•) and p (•) . In the terminology 
of Ref. 4, the union of all 1-winning (or 2-winning) sets together with 
(or Tg) is Sg (or Sp) . 

In the next section we consider the problem of finding winning 
strategies by giving a theorem of conditions sufficient for a set to be 
1-winning (2-winning). 


3. WINNING SETS 


The game as defined in Section 2 is completely symmetrical with 
respect to players 1 and 2. In this section we give conditions sufficient 
for a set to be 1-winning. Of course, the theorem with 1 and 2 interchanged 
holds equally for a 2-winning set. 

The conditions in the theorem below depend on an a priori chosen 
quadruple {V-|(*) , V 2 (*) , k-j , kg) where V^.(-) : D ->■ , i = 1, 2, are 

functions for which there exist constants and Cg such that 

i) 3 Mx e D I V^(x) < C^} 
ii) Tg c Ag ^ {x 6 D I V 2 (x) < Cg} 

and 

iii) k^ > 0 , kg are scalar constants. 

Given a quadruple (V^(*) , Vg(0 , k-j , kg) . let 


W(V^, Vg, 





(4) 


OF POOR QUAUPxi 
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Before stating a theorem, we introduce another assumption. 

Assumption 2 . If D = , given p'' ( • ) ^ , i = 1 , 2, and a quadruple 

{Vi(*)» V 2 (*)» k^, k 2 > . no solution of (3) with (x^^, tg) e W(V^ , * kg) x R^ 

has a finite escape time. 

This assumption is satisfied if 
i) equation (3) satisfies a linear growth condition, or 
ii) function Vi(*) in Theorem 1 below is radially unbounded; 
that is, V^{x) ~ as 11x11 *»■«>, 


Now we are ready to state the main theorem. 

THEOREM 1 . ^ there exist ^ quadruple {V-j ( • ) > Vg ( • ) . k^ , kg) » ^ strategy 
(*) ^ a. function p^ (•) : D -k alj_ nonempty subsets of , such that 

i) p^{x, t) = p^(x) V(x, t) e D X R^ , 
ii) V X e w{V^, Vg, k^, kg) and V e pl(x). 


sup W,{x) f{x, u^ , u^) < - ki 

O O I I 




inf VV„(x) f(x, u^ u^) > - k, 
2 2 ^ ^ 


i i i ) Assumption 1 i^ met, 

11 2 2 

iv) D i^ ^ invariant set of (3) with p {*) = p (•) an^ all_ p (•) ^ P > 
or else D = R*^ and Assumption 2 Is satisfied , 
then W(V.j , Vg, k-| , kg) is 1 - winning . 

Proof . First we show that if a trajectory of (3), with p^(.*) = p^(*) , 
any p^(*) € P^ and (xq, t^) e W(V^, ^^2’ h’ *^2^ ^ ’ remains in 

W(Vi, Vg, ky, kg) for t < t^ , then it terminates on T.j u Tg ; that is, 

5ii) of Definitipn 1 cannot occur. In view of condition iv), no such 
trajectory has a finite escape time and so may be 
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extended over any interval [tg, t^) , including = « in case of 
nonterinination. Consider a trajectory corresponding to solution 
x(*) : [tg, t^] ’*■ D , or x(*) ; [tg, t^) D if t^ = « , with 
x(to) = Xg s W(V-j , Vg» 1 k 2 ) . In view of ii) and the supposition that 
x(t) ew(V^, Vg. k^, kg) for te [tg, t^) 

7V^(x(t)) x(t) < - 

vVg(x(t)) x(t) > - kg 


a.e. [tg, t^) . Upon integration, e.g., see Ref. 7, we obtain for 


t ^ [tQ > t^) 


V,(xo) >V,(x(t)) + k,{t - tj) 

(5) 

V 2 (Xg) < Vj(x(t)) + kj(t - tg) . 

(6) 


Let 



Vi(Xg) - C.^ 
+ 


(7) 


and suppose that t < t^ . Then it follows from (5) and (7) that 
V^(x(t)) < . 

By the definition of V-j(*) , namely, ^ , this implies that 

x(t) s , contradicting the supposition of termination at t = t^ or 
else non- termination, t^ = « . Thus, t > t^ and termination must 
occur on l*i ^ Tg at t = t^ < “ . 


Next we demonstrate that termination takes place on T^ Tg . 
Two cases must be considered, kg < 0 and kg > 0 . 

For kg < 0 , since 


OBlGINALr^GBJS 



- 8 - 


V^(x) - > 0 for X G D \ 

(8) 

Vg(x) “ Cg > p for X e D \ Ag 

(9) 

it follows from (4) that 


W(V^, Vg, k^, kg) = D \(r^ u Ag) • 

(10) 


Hence, by condition iv), x(t) e W(Vp Vg, kp kg) for t e [tQ, t^) . 

In view of (9), for each Xq e W(Vi» Vg, k-j, kg) there exists an e > 0 
such that 

~ ^2 ^ ^ ’ (11) 

Since x(t) e W(V^, Vg, kp kg) for all t e [t^, t^) , it follows 
from (6) that 

V 2 (Xq) <Vg{x(t)) V ts [tg, t^) (12) 

whence, by (11 ) , 

Vg(x{t)) > Cg + e V te[tQ, tp 

which implies that x(t^) ^ Ag d Tg . But x(t^) e u so that 
x(tf)eT^\r2 . 

For k 2 > 0 , suppose there is a t < t^ for which 
x(t) 4 W(V-|, Vg, k-| , kg) . Then, by continuity of Vi(*)» Vg{*) and x(*)» 
there exists a t < t^ such that 
x(t) e W(V^, Vg, k^, kg) V t e [tQ, t) 
and 

k, kg 

1 — _ = _2 . ( 13 ) 

V.,(x(t))-C^ Vg(K(t))-Cg 



Now, (4) and (5) hold for x(t) s W(Vi» V 2 » k, , kg) and so, by continuity 
of V|(’) and V 2 (*) and by positivity of k.j and kg , 


Vi{xn)-C, VT(x(t))-C, . 

-4^^^ ' k - ' 


Vjlxjj-Cj Vgixitjj-Cj 


+ (t - t(|) . 


Since Xq^WCV-j, Vg, k.j , kg) , it follows from (4) and (14) that 

k| kg 

_J > J. . (15) 

Vi(x(t))-Ci Vg(x{t))-Cg 

This contradicts (l3), and so 

x(t) e W(Vi, Vg, k^, kg) V t e [t^, t^) . 

Thus, as shown earlier, x(t^) e u Tg . 

Now suppose there is a t < t^ such that x(t) ^ Ag \ ^ "^2 ' ^1 

and x(t) <f u Ag 3 T.J u Tg for all t e [tg, t) . Since x(t) ^ Ag \ 

V^(x(t)) > C.| (16) 

and 

Vg{x{t))<Cg . (17) 

Substitution of (16) and (17) in (14) yields 


■"I . 1 

^"^1 t-tfi 


i 
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and 

_L_ 

t-tQ 

so that 

k] kg 

V2(XqT“C2 

which contradicts Xq e W(V^s Vg, kg) . Hence, x(t) Ag \ d Tg \ 

for t «s tp so that x(t^) € \ Ag c \ Tg . 

Since these conclusions hold for all Xq e W{V^ , Vg, k-j , kg) , 

that set is a 1-winning set. 

Remarks 

1. Since a winning strategy p^(*) with (xq, tg) e W(V^ , Vg, k^ , kg) x R^ 

guarantees that x(t) e W(V^ , Vg, k^, kg) for all te [t^, t^) , only 

the restriction of the strategy to the 1-winning set need be determined. 

2. There may exist 1-winning strategies at (Xq, t^) 4 W(V-|, Vg, k^, kg) x r^ . 

In general, however, such strategies will not be 1-winning at other 

initial points. 

3. If kg < 0 , region Ag is an avoidance set in the sense of Ref. 8, 

4. As k^ ■+■ 0 , t given in {7). tends to «• . Thus, if = 0 , 

termination cannot be guaranteed; in particular W(V^, Vg, k-j , kg) 

need not be 1 -winning. Hov/ever, the inequality in (4) then requires 
kg < 0 so t[iat, by the second of conditions ii) of the Theorem, 

W(V-|, Vg, k|, kg) cannot be 2-winning. 

5. If Tg = (|) , let Vg(x) = constant Cg for all x «= d \ T-j and 
let kg = 0 . The inequality in (4) is then satisfied trivially. 


The set W(V^, Vg* kii k^) befng l-w1nn1ng is then equivalent to 
target T-j being capturable in finite time. Theorem 1 is thus 
related to the target capture theorem of Ref. 9. 

6. Let 

S{i) 6 {xe W(V^, Vg, k,, kg) | V^(x) C A) 3 u Tg 

and suppose that it is required to accomplish termination on 

\ Tg for all x^e s(a) in a time interval not exceeding t - tg . 

This can be assured by the conditions of Theorem 1 with 

k, . 08) 

For, as shown in the proof of Theorem 1, for given XqG W(V^, Vg, k^, kg) 

t s tp+ ■ > t^ 

^ "fc 

and x(t-) 6 T, \ T„ . Thus we impose sup t < t , whence 

^ XoSS{A) 

A-C, * 

^f “ ^ “ ^0 

giving the condition (18). 

7. If more than one set, say Tg, Tg, ..., T^, is to be avoided before 
terminating on T-| \ (Tg u Tg u ... u r^,), the conditions of Theorem 1 
are augmented by introducing for i e {2, 3, ...» r} 

A. ^ {xe D I V.(x) <C.} DT. , 

replacing W(V^, Vg, k^ kg) by 

< f. 

W(v^, Vg, ..., Vj,, k^, kg, k^) = {X 6 D \ (T^ U Ag u ... u a^ | 

^1 ^i • o 

vj(x)-c^ ^ v.(xj-c: ’ ■' ^ • ' * ’ 




and requiring V e p^(x) 
inf VV,{x) f(x, u\ u^) > - k 

4. EXAMPLE 


Here we illustrate the use of Theorem 1 by means of a very simple 
example, a pursuit-evasion game between inertialess objects P and E with 
constant speeds Vp and v^ , respectively. The equations of motion (see 
Figure 1) are 


R = Vg cos (a + 0^) 

■ ' 

0 = -f sin (a + 0^) 

f = Vn cos 0„ - Vn cos 0p 

P P L E 

0 = 7 (vp sin 0p - Vg sin 0^) 

The targets of E and P , respectively, are 
T-j = {(R, 0, r, 0 ) e R^ I R < = constant > 0} 

Tg = {(R, 0, r, 0) € I r < pp = constant > 0} • 


(19) 


( 20 ) 


Thus, the evader, E , wishes to choose the values of 0^ so 
that he reaches T-.(R = Pg) before he is intercepted (r = pp) , no 
matter how the pursuer, P , chooses the values of 0p . 

To apply Theorem 1 , let 
V, = R , ■ 
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so that ® 7*^ , i = 1, 2, and 
VV^ =(1.0, 0. 0) 

W2 = (0, 0,1,0) . 

I' 

Conditions ii) of Theorem 1 become 
Vp cos (a + 0^) < - <0 

-Vp - Vg cos 0E> - kg 

and WlV-j, Vg. kp kg) is defined by 

kg 

r - Pp > iq- (R - Pg) . 

Condition (21) implies 

h 

“1 < cos (a + 0r) < - vr^ < 0 
t V|; 


( 21 ) 

( 22 ) 


(23) 


(24) 


so that 

^1 ” T+6^ 6 s [0, “) . 

For give.; k-j , region W is maximized by choosing the smallest 
kg such that (22) is met for all possible a = 0 0 . This results in 

“^2 " V 1+6 

whence 

Kn V p 

^=l + (l+6)^ . 

1 E 

Hence, the largest W results from 6=0, namely. 
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V-+V„ , , 

r-pp>4^CR-PE) • (25) 

The ccrresponcHng escape strategy, according to (24), is given by 
cos (a + 0^) = “1 ; that is, E moves radially inv/ard and is assured 
termination without interception by P provided the initial conditions 
satisfy (25). 

Strategy 0^ = it - (Q -O) is continuous on D = . Hence, 

for sufficiently well-behaved 9p , system (19) possesses a solution at 
every initial state. Furthermore, (19) satisfies a linear growth condition. 
Thus Assumptions 1 and 2 are met and 'W given by (25) is indeed 1-winning, 
that is, winning for the evader, E . 

Since Vp and v^ are positive, (25) implies that 

r - pp > R - pg no matter how much faster the evader is than the pursuer. 
Thus, W(V-j, V 2 , , kg) dqes 'not include initial configurations for 

which P lies between E and his target, T-| . This restriction is not 
surprising since Theorem 1 relates to all initial positions for which the 
evader's strategy is winning (see Remark 2). 
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List of Symbols 


X lower case "eggs" 

X "multiplication" symbol 
0 zero 

T script upper case "tee" 

e "belongs to" symbol 

e lower case epsilon 
p lov/er case rho 

0 lower case theta 

0 upper case theta 

a lower case alpha 

6 lower case delta 

A upper case delta 

IT lower case pi 

a script lower case "ell" 
"infinity" symbol 
"empty" symbol 
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